SUBCLASS 




FIG. 1 




FIG.U 



BY I CUSS j SUBCLASS | 



UJ 

o y 

CC LU 

IB 

CO 



^13 
yl 

111 
'•J. = 

IIJ 




^ UJ 


ui 


CO 


o 


o 


o 


z 


2 



LO. 




APPROVED 


O.G. FIG. ! 


By 


CLASS 


SUBCUoS| 


DR/.nrSMAN 







FI0.5 




TIME 



FIO .6 



Sk(f ) 




OHz 128 

L, EQUISPACED 

SAMPLES 



^Hz 



FREQUENCY 



FIO, 7 



isk(f>l| 




OHz 



19 

LOGARITHMICALLY 
SPACED SAMPLES 



/.KHz 



FREQUENCY 



APPROVED 


O.G. FIG. 


BY 


CLASS 


SUBCLASS 









logllSinil 



FIG. 8 




FREQUENCY 



C^M) 



Qi I I 
Co Ci^C2 



FIG, 9 




FIG, 10 93xi 



91 



I 



BUILD/UPDATE 
MODULE 



^9Z 



- H 



QUEFRENCY 



WORD MODELS 



NOISE MODEL 



23 



LANGUAGE MODEL 



21 



APPROVED 


O.G. FIG. 1 

~ . 


BY 


CLASS SUBCLASS 


DR/.rTSMAN 





^ START ^ 



INPUT TEXT OF NEW 
PHRASE INTO THE SYSTEM 



I 



PROMPT USER FOR 
PHRASE VIA MICROPHONE 



•S3 



I 



PROMPT USER FOR WORDS 
IN PHRASE THAT HAVE NOT 
ALREADY BEEN INPUT VIA 
MICROPHONE 



-S5 




YES 



GENERATE WORD MODELS FOR 
UNKNOWN WORDS 
THAT ARE INCLUDED IN AT 
LEAST TWO PHRASES INPUT 
INTO THE SYSTEM 



S9 



^ END ^ 



F/G.11 




p-1 



p+1 



115 



123 
125 

127-4 



PARAMETER FRAMES 



PHRASE WORDS 



STATUS 



125 



/ 



/ 



/ 



\ 



\ 



\ 



/ 
/ 

/ 

/ 

\ 

\ 

\ 

\ 



/ 



TEXT , --12 9 



PHRASE No. 



WORD No. 4—131 

.133 
'135 



TIME BOUNDRIES 



WORD INDEX 



w-2 w-1 w-»1 



117 



\ 



PARAMETER FRAMES 



PHRASE INDEX 



STATUS - ^141 



'4-137 
139 



FIG. 12 



APPROVED 
BY 

Da- 'i J'.'AN 



OG.JiG. 

CLASS 



II 



( START 3 



I 



ALIGN THE PHRASES CONTAINING THE 
UNKNOWN WORD WITH THE UNKNOWN 
WORD USING A FLEXIBLE DP 
ALIGNMENT ALGORITHM 



AVERAGE BEGINNING AND END POINTS 
FOR EACH UNKNOWN WORD AND 
CHOP WORD USING AVERAGES 



ALIGN THE PHRASES CONTAINING THE 

UNKNOWN WORDS WITH THE -k-S25 
CHOPPED VERSIONS OF THOSE WORDS 
USING A DP ALIGNMENT ALGORITHM 



AVERAGE ALIGNED FRAMES AND 
REPLACE THE FRAMES OF THE 
INDIVIDUAL CHOPPED WORDS. 
INTERPOLATING IF NECESSARY 



C END ^ 



FIG. U 



BY rEJisT^UBCLASS 




subcla::3 I 

.. ■- ^ 



S30 



F/G. 17b 



IS FIRST WORD^ 
CONNECTED' 
0/POFNODENo^ 



YES 



NO 



ADD FIRST WORD TO 
0/P OF NODE No 



S31 



w = 0 



S32 




S39 



YES 



S35 



CREATE NODE AND 
CONNECT WORD w TO 
l/P OF THAT NODE 



T 




CONNECT LAST WORD 
TO l/P OF NODE Nn 



YES 



1 



S37 



ADD WORD w+1 TO 
0/P OF THAT NODE 




END 



w = w + 1 



S38 





6.G. Fia _J, 


1 BY 




SUBCLASS a 


IpR/rrsMAN 








F 1 0.22 



WORD = 



201 



So 


Si 


S2 


S3 


Si. 


S5 


se 


s? 


SB 


S9 


Sd 



-203 



ACTIVE LIST = 



s? 


S5 


Si. 


S3 


S2 


Si 


So 




i=1 


i=2 


i=3 


1=1. 


US 


U6 



MEW ACTIVE LIST = 



•205 



I APPROVED 


. . . "'^ 

O.G. FIG. 1 


1 BY 


CLASS 


SUBCLASS 1 






.1 



r START ") 



INITIALISE 
k = 0 



— S41 




S43 



INTERNAL - 
PROCESSING 
OF WORD w 








u*^ - 



•547 



549 



FIO. 21 



565 

-H— 



ADJUST Th 



PROCESS , 
NODES 






iNiTi; 

w 


U.ISE ^ 
= 0 



—551 



—553 



555 




UPDATE ENTRY 
STATES OF 
WORD w 



NO ^ 



563 



561 
—i— 

k = k + 1 



I 



557 



w 



=w+i --559 




APPROVED 




BY 


ri & SUBCLASS | 


DR' ;~SMAN 





F/ J . 23 



Sg 

WORD MODEL 
201 Sb 




♦k-l, h-3 *k-2 <k-1 <k *k+l 





U.bi. i-fG, j 


BY 




cr:^ ..r.:A;^ 


= A. I 



START ^ 



SET LA = So 
SET D ISq] = HUGE 



S71 




SET i = 0 



SIS 



PROCESS STATE IN CURRENT 
ACTIVE LIST AT POSITION I AND 
UPDATE NEW ACTIVE LIST ' 



I 



-S77 



i = i+1 



-S79 



YES 




MAKE NEW ACTIVE LIST OLD 
ACTIVE LIST 



S83 



STORE LA 



S85 



CElD F/a 24 




FIO, 26b 



i=l 



59 So S7 $6 S5 



^205 



T 

LA 



\ 




•S92 



FIG. 27a 



CALCULATE 

d ( S.f k) 
AND ADD TO 
D[S] 



— S93 




S107^- Self in =0 



j=J-1 



'S109 





S111 



YES 



Dljl = D[S] S113 



I 




S121 



YES 



ADD STATE j TO 
NEW ACTIVE LIST 



I 



— S115 



ADD STATE j TO ^cioc 
NEW ACTIVE LIST • -^'^-^ 



Self[jl = 0 



I 



-S117 



Self[jl = Self[j] + 1 



j = j-1 .-5119 



I 



-S127 



LA = S 



S129 



LA = S + 1 



F 1 0.27b 




S131 



S133-'-MINSCORE = DlSl 



i APPROVED 



aG.r-3._ 
class 's TuECL/.rj.'; 



1 



F/0. 28 



( START ) 



S151 



CALCULATE 




" d (noise, f|() 


SI SI 



INITIALISE 
v= No 




MINSCORE=D[Vl 



AC0UNT = AC0UNT+1 



UPDATE INSCORE OF 
EACH WORD CONNECTED 
TO OUTPUT OF NODE[v ] 



D[V] = MIN 



S165 
4 



DlvL^MINf (SDDJ 




PAC0UI\IT=PAC0UNT+1 
— t 



S171 



S173 



YES 



END ^ 



BY 



CLASS 



i 



yj 
U1 

I- 
nJ 

lij 



CD 



1 1 


1 


• 










1 1 J 






IHi 












On! 




CO 








CO 












CO 



CO 




CO 




CO 




UJ 










CO 










• 


• 


■ 


• a 



^ APPROVED 


lOG. 5-13. 


1 FY 


CLASS 1 SUBCLA33 





FIG. 30 



( START ^ 




YES 



D[j] = INSCORE 



ADD STATE Ij] TO 
CURRENT ACTIVE LIST 



S203 



j=j-i 
7^ 



1 



INSCORE = HUGE 



3 



S1974. 

•S205 



SELFlj] = 0 

S195 



ADD NUMBER OF STATES 
ON CURRENT ACTIVE LIST 
TO PACOUNT 



S207 



^ END ) 



1 



APPROVED G,G\ RG. 



START ^ 



S211- 



S221 



PRUNING = PRUNING + dpi 



S213 



S223 




S229 



PRUNING = LOWPRTH 



PRUNING = PRUNING + dp2 



Th = MINSCORE + PRUNING 



■S231 



COUNT NUMBER OF 
POTENTIALLY ACTIVE 
STATES THAT WILL BE 
PROCESSED = Osa " 



c 



S233 S235 




END 



S237 



YES 



FIG. 32 




O.G. FIC3. 

CLASS 5 SUCCLAS3 




c 



START ) 



S25r 



INPUT UTTERANCE FROM NEW 
USER AND WORD SEQUENCE 
THEREOF 



ALIGN THE UTTERANCE WITH 
WORD MODELS KNOWN TO 
BE IN UTTERANCES 



REPLACE WORD MODELS WITH 
S255--f SEQUENCE OF UTTERANCE 
FRAMES ALLIGNED THEREWITH 




FIG. 3U 



S261 



S263 



INPUT UTTERANCES FROM NEW 
, USER AND WORD SEQUENCE 
THEREOF 






ALIGN EACH UT 
_^WORD M0DEL5 
IN UTT 


TERANCE WITH 
) KNOWN TO BE 
ERANCES 



S265 



REPLACE WORD MODELS WITH AVERAGE 
FRAMES ALUGNED THEREWITH. 
INTERPOLATING WHERE NECESSARY 





293b 



FI038 ^273 

309 



1 



CONTROL 
UNIT 



303 



SWITCHING 
UNIT 




307b 



307a 



FIG.39 310 .323 329 /27_3 



RECOGNITION 
UNIT 




321 325- 



COMMAND 
INTERPRETER . 




I 



331- 



COMMAND 
EXECUTER 



i 



MEMORY 



STATUS 



328' 327 330 



332 



FIG. 



351 



353 



355 



MESSAGE 1 
MESSAGE 2 




MESSAGE 1 
MESSAGE 2 




MESSAGE 1 
MESSAGE 2 




MESSAGE 1 
MESSAGE 2 


r 

352 









357 



FIG. 4 / 



COMPARE CALLER ID'S 



S301 




S302 

NO 



S304 



UPDATE CURRENT MESSAGE 
LIST AND REQUEST 
CONFIRMATION 



OUTPUT - "NO MESSAGES 
FROM THAT CALLER" 




S305 



PLAY FIRST MESSAGE ON 
CURRENT MESSAGE LIST 



"^S306 



S303 



S307 




YES 



WAIT FOR NEXT 
SPEECH COMMAND 




■S309 



